Click any tag below to further narrow down your results
Links
OpenAI introduces LifeVal, an evaluation of everyday practical tasks like finding housing, managing budgets, accessing government services, and shopping, which the company used to track ChatGPT's progress over the past year. The goal is to measure whether AI can take actions that actually get things done, not just give advice.
- The tasks were chosen from areas where users most want help: caregiving, health, education, household administration, personal finances, shopping, and government services.
- The benchmark tests action-taking, such as adding a deed to a cart for review, rather than only chat-style answers.
- OpenAI says it has used LifeVal to track and drive model improvement on everyday tasks over the past year, and frames it as a step beyond academic knowledge tests.
@lennysan on X
Tibo Sottiaux, Head of ChatGPT and Codex at OpenAI, shares his predictions from a conversation with Lenny Rachitsky: agents will soon handle most internet actions, the model picker will disappear, and today's clever agent scaffolding will become obsolete as models improve. He also covers what skills matter now, how OpenAI hires, and the burnout risk of running dozens of agents at once.
- Most internet actions will be taken by agents, and Notion's MCP server launch already showed how quickly agent traffic can strain a product's systems and economics.
- Tibo expects models to get dramatically better and cheaper, so he advises building as if they will be about 10 times better within a year, and he says his own forecast was too slow.
- Agent teams should grow and shrink with each model release, since a larger model can absorb tasks that once needed elaborate loops and graphs.
a16z's seventh ranking of consumer AI apps shows ChatGPT maintaining dominance while Claude surged to #3, but the real story is that spending follows a power law — the top 1% of payers account for nearly 20% of all consumer AI spending, and most paying users are prosumers buying coding and creative tools rather than mainstream consumers.
- Only 4.5% of U.S. consumers have paid subscriptions to ChatGPT, Gemini, or Claude as of August, and just 25% use AI daily, revealing extremely narrow monetization despite broad awareness.
- The top 1% of AI spenders average $903/month and account for 19.5% of total consumer AI spending, while median payers spend $25/month — a stark power law distribution that's driving revenue concentration in productivity and creative tools.
- Claude jumped from not ranking in September 2023 to #3 by traffic and tied with Gemini in paid subscribers, but showed signs of slowdown by mid-summer as ChatGPT re-accelerated with new features and work-focused products.
- Personal AI agents (Instinct, Tomo, Lindy) are emerging as a new monetization model, with early adopters spending $1,300/month on average and transaction-based pricing potentially enabling deeper consumer adoption than subscription models.